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Abstract. Objective: Hospital restructuring often 
results in fewer inpatient beds, increased ambulatory 
services, and closures of hospitals or emergency de- 
partments (EDs). The authors sought to determine 
the impact of systematic hospital restructuring on ED 
overcrowding. Methods: Time series analyses of av- 
erage monthly overcrowding for EDs in Toronto, On- 
tario, Canada, from 1991 and 2000 (n = 20 hospitals, 
120 months) were conducted. Autoregression models 
evaluated the rate of increase of overcrowding before 
and during systematic restructuring. A secondary 
analysis included total ED visits, patient age, and sex 
distribution as covariates. Seasonality was assessed 
by means of spectral analysis. Results: Severe and 
moderate overcrowding averaged 3% and 14% of the 
time each month, respectively, over the whole period. 
Before restructuring (n = 74 months), severe and 
moderate overcrowding averaged 0.5% and 9% per 
month, respectively; during restructuring (n = 46 
months), the monthly averages were 6% and 23%, re- 
spectively. Neither severe nor moderate overcrowding 



was increasing before restructuring. During restruc- 
turing, however, both increased significantly (severe 
0.2% per month [p < 0.0001]; moderate 0.5% per 
month [p < 0.0001]). Similar results were found after 
controlling for ED utilization. Female gender inde- 
pendently predicted increased overcrowding; older 
age predicted reduced moderate overcrowding; num- 
ber of total visits was not a predictor. Spectral anal- 
ysis revealed significant seasonality in overcrowding. 
Conclusions: Hospital restructuring was associated 
with increased ED overcrowding, even after control- 
ling for utilization and patient demographics. Re- 
structuring should proceed slowly to allow time for 
monitoring of its effects and modification of the pro- 
cess, because the impact of incremental reductions in 
hospital resources may be magnified as maximum op- 
erating capacity is approached. Key words: emer- 
gency department; overcrowding; hospital restructur- 
ing. ACADEMIC EMERGENCY MEDICINE 2001; 8: 
1037-1043 



THE unpredictable nature of acute illness and 
injury makes access to timely emergency 
medical care an essential part of modern health 
care systems. In the United States, some 100 mil- 
lion emergency department (ED) visits occur an- 
nually, 1 while in Canada, the figure is closer to ten 
million. 2 Widespread reports of ED overcrowding 
have raised doubts about the capacity of emer- 



From the Department of Emergency Services (MJS, BS), Clin- 
ical Epidemiology Unit (MJS, JPS, DAR), and Division of Pre- 
Hospital Care Research Program (MJS, BS), Sunnybrook and 
Women's College Health Sciences Centre, Toronto; and the In- 
stitute for Clinical Evaluative Sciences (MJS, JPS, DAR), 
Toronto, Ontario, Canada. 

Received March 7, 2001; revision received June 7, 2001; ac- 
cepted July 12, 2001. 

Address for correspondence and reprints: Michael J. Schull, 
MD, MSc, G-147, Sunnybrook and Women's College Health Sci- 
ences Centre, 2075 Bayview Avenue, Toronto, Ontario, Canada, 
M4N 3M5. E-mail: mjs@ices.on.ca 



gency health systems to provide rapid and depend- 
able care. 3-6 

In the United States, surveys of hospital direc- 
tors have reported ED overcrowding in almost 
every state, 7-10 with 10% to 30% of hospitals sur- 
veyed reporting daily overcrowding. 810 Emergency 
department overcrowding has also been reported 
in Canada 3 ' 41112 and Europe. 1314 These reports of 
overcrowding have coincided with the restructur- 
ing of hospitals and health services due to financial 
cutbacks and efforts to modernize health care de- 
livery. 15-17 The result has been hospital closures 
and enhanced ambulatory and community health 
services. 3 ' 15 ' 16 

The objective of this study was to determine 
whether the systematic restructuring of a hospital 
system was associated with increased ED over- 
crowding. The restructuring of Toronto's hospital 
system began in 1997 and entailed changes that 
were widespread and complex. 1518 Hospitals and 
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EDs closed or merged, various specialized clinical 
programs were concentrated in fewer hospitals, 
and increased investments were made in commu- 
nity, ambulatory, and home care services. 1819 De- 
termining the impact of restructuring on emer- 
gency services is important since similar changes 
are planned or under way in many jurisdic- 
tions. 1516 Understanding their impact may help 
avoid or lessen negative effects on emergency ser- 
vices as restructuring takes place elsewhere. 20 

Methods 

Study Setting and Population. The study setting 
was metropolitan Toronto, Canada's largest urban 
center with a population of more than 2.3 million 
people. Data on ED overcrowding were obtained 
for a ten-year period from January 1991 to Decem- 
ber 2000. At the end of the study period, Toronto 
had 15 hospital-based EDs, all of which operated 
within a public system of universal health insur- 
ance. The city's hospitals provided acute medical 
care for the vast majority of Toronto residents, but 
also secondary, tertiary, and quaternary care for 
some patients in surrounding regions. One hospi- 
tal was the city's only pediatric emergency quater- 
nary care center and never diverted ambulances; 
it was excluded from the study. A single publicly 
funded ambulance service with a centralized dis- 
patch system provided all out-of-hospital care for 
the city. In 1999, Toronto Ambulance Services re- 
sponded to 193,000 unscheduled patient requests 
for transport. 

Emergency Physician Services. The Ontario 
Health Insurance Program (OHIP) pays for the 
vast majority of emergency physician services at 
most of the hospitals on a fee-for-service basis; only 
work-related injuries, and services to patients from 
other countries or other provinces, are not billed to 
OHIP. 21 Physicians at four EDs are funded under 
government-administered alternative payment 
plans and their services are not billed to OHIP. 
However, these sites still report patient visits to 
OHIP so that utilization of emergency services can 
be monitored. 22 

The Systematic Restructuring Process. A prov- 
ince-wide review of hospital services began in On- 
tario in 1996 with the creation of the Health Ser- 
vices Restructuring Commission (HSRC) by the 
provincial government. 1518 The HSRC was man- 
dated to review hospital services across the prov- 
ince, and had the authority to order their system- 
atic restructuring. 1518 For the purposes of this 
study, systematic restructuring is denned as a pro- 
cess that is coordinated between hospitals and 
overseen by a central authority. The commission's 



recommendations for Toronto were released in 
March 1997. 18 

Definition of Overcrowding. Emergency depart- 
ments were denned as overcrowded during periods 
of ambulance diversion. Providing rapid medical 
care to acutely ill patients is the prime mission of 
EDs, and this often depends on rapid ambulance 
transport to an accessible ED. Disruption of this 
link by ambulance diversions may, therefore, com- 
promise health in the community. 3 ' 6 ' 23-27 The diver- 
sion of ambulances in Ontario is governed by a cri- 
teria set by the Ministry of Health, and its use is 
monitored. Throughout our study interval, Toronto 
Ambulance Services participated in a centralized 
system that allows ambulances to be diverted 
away from overcrowded EDs. The EDs continu- 
ously update their conditions to the dispatch cen- 
ter: normal (all ambulances accepted); re-direct 
consideration (no ambulances accepted except 
those with critically ill patients); and critical care 
bypass (no ambulances accepted). Paramedics may 
override a hospital's status if they believe the pa- 
tient requires specialized care available only at 
certain hospitals (e.g., a trauma or burn center). 

The Determinants of Overcrowding. Emergency 
departments were denned to be severely over- 
crowded during periods of critical care bypass, and 
moderately overcrowded during periods of re-direct 
consideration. An Ontario Ministry of Health Stan- 
dard governs the criteria by which decisions should 
be made to divert ambulances. In general, the de- 
cision to divert ambulances is made by the attend- 
ing emergency physician and/or ED charge nurse. 
Conditions other than normal automatically expire 
after a standard interval; critical care bypass is 
downgraded to re-direct consideration after 30 
minutes, and re-direct consideration is down- 
graded to normal after 120 minutes. Emergency 
departments may renew, upgrade, or downgrade 
their conditions at any time. 

Dependent Variable: Average Monthly Over- 
crowding. Time series of average monthly over- 
crowding at all Toronto EDs were constructed sep- 
arately for moderate and severe overcrowding. For 
both analyses, the total time (in minutes) per 
month that each ED was overcrowded was calcu- 
lated, then the times were summed for all EDs. 
Total monthly overcrowding was converted into the 
percentage of "available minutes" in the following 
manner: [T/(D X 1,440 X ED)] X 100, where "T" is 
the total minutes of overcrowding at all EDs in the 
month, "D" is the number of days in the month, 
1,440 is the number of minutes in the day, and 
"ED" is the number of open EDs in the month. In 
the appropriate months, we adjusted the formula 
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Care Beds* 
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Annual Volume 


Average Age (Years) 
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Q TOT 




n/a 


n/a 


n/a 


1992 


9,337 


20 


n/a 


n/a 


n/a 


1993 


8,576 


20 


545,464 


36.8 


49 


1994 


8,283 


20 


547,500 


37.3 


50 


1995 


7,499 


20 


575,641 


37.6 


50 


1996 


7,383 


20 


608,190 


38.2 


50 


1997 


6,837 


18 


588,807 


39.0 


51 


1998 


6,482 


17 


571,818 


39.7 


51 


1999 


6,324 


16 


545,705 


40.1 


51 


2000 


5,894 


15 


538,316 


40.9 


52 


*A11 Toronto hospitals, at fiscal year's end. 19 



f Twenty-four-hour/day EDs, at calendar year's end. 



for the one ED that reduced its hours of operation 
during the restructuring period. 

Data Sources. Data consisting of the minute-by- 
minute real-time ambulance diversion condition 
reports for all metropolitan Toronto EDs were ob- 
tained from Toronto Ambulance Services for the 
period of January 1, 1991, to December 31, 2000. 
Data regarding all ED visits were obtained from 
the billing records of OHIP. In Canada's system of 
universal health insurance, physicians' services for 
the vast majority of ED visits are billed to OHIP. 
Emergency department visits can be differentiated 
in OHIP records based on their unique billing 
codes. Multiple billings by different physicians for 
a single ED patient (e.g., ED physician and con- 
sultant seeing the same patient) can be readily dis- 
tinguished by the specific codes used for each pur- 
pose. To avoid counting a single patient visit 
multiple times, we included only billings paid to 
the initial ED physician. Patient demographic in- 
formation such as age and sex are also present. 
The OHIP data from April 1992 to March 2000 
were available for analysis. Using OHIP data to 
determine utilization will miss some patients if the 
physicians' services were not be billed to OHIP 
(e.g., hospitals where physicians are paid via al- 
ternate payment plans rather than fee-for-service, 
patients living outside of Ontario, uninsured pa- 
tients, incorrect OHIP numbers, left without being 
seen). The study was considered exempt from re- 
search ethics board approval since only aggregate 
patient data were used. 

Crude Analysis. Autoregression analysis 28 was 
used for both time series since we could not as- 
sume the observations were independent from 
each other (i.e., overcrowding in one month may 
affect the next). The months up to February 1997 
were defined as the period before restructuring, 
and the months from March 1997 on were defined 



as the period during restructuring. This is consis- 
tent with the March 1997 release of the HSRC re- 
port's recommendations for Toronto and the timing 
of the restructuring changes it recommended. In 
the crude analysis, the independent variables in- 
cluded 1) time (expressed in months), 2) period (be- 
fore or during restructuring), and 3) a prespecified 
interaction term between restructuring period and 
time. All autoregression models incorporated lag 
terms for the 12 prior months to account for sea- 
sonality and the autocorrelation of observations. 28 

Interpretation of Crude Analysis. The coefficient 
of the time variable represented the monthly rate 
of change of overcrowding in the average ED, and 
the test of significance determined whether the 
rate was significantly different from zero. The in- 
teraction term coefficient represented the differ- 
ence between the rates of change in the two inter- 
vals, and its test of significance determined 
whether the two rates were significantly different 
from each other. The presence of seasonality was 
assessed by means of spectral analysis and the 
Fisher's kappa (FK) and Bartlett-Kolmogorov- 
Smirnoff (BKS) statistics. 29 

Multivariate Analysis. A multivariate analysis 
was conducted for both severe and moderate over- 
crowding with three covariates added to the mod- 
els: 1) total monthly volume of ED patients pre- 
senting to all Toronto EDs, 2) the average age of 
all ED patients per month, and 3) sex distribution 
(proportion of female patients). The secondary 
analysis was conducted from April 1992 to March 
2000 since data for covariates were available only 
for this time period. 

Results 

The hospital restructuring process resulted in clo- 
sures or mergers of nine acute care hospitals in 
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Toronto, the creation of ambulatory care centers, 
the concentration of some clinical programs in 
fewer hospitals, and increased ambulatory and 
community health services. Prior to restructuring, 
there were 20 hospital-based EDs; during restruc- 
turing, four closed and a fifth converted to an ur- 
gent care center. 19 All hospital and ED closures oc- 
curred during restructuring, but the number of 
staffed acute care beds decreased both before and 
during restructuring. Out of a total of 9,727 acute 
care beds at Toronto hospitals in 1991, 2,890 were 
closed by 1997, with a further reduction of 943 
beds by 2000 19 (Table 1). 

Monthly overcrowding data were obtained for 
all EDs for a total of 120 months in = 74 before 
restructuring and n = 46 months during restruc- 
turing). Over the entire time series, the average 
ED was severely overcrowded 3% of each month, 
and moderately overcrowded 14% of each month. 
Before restructuring, severe and moderate over- 
crowding averaged 0.5% and 9% per month; during 
restructuring the corresponding monthly averages 
increased to 6% and 23% per month. Spectral anal- 
ysis suggested the presence of seasonality for both 
severe and moderate overcrowding (FK and BKS 
tests, p < 0.05). 

Rates of Change of Monthly Average Over- 
crowding. Time series of monthly average over- 
crowding are shown in Figure 1, along with the 



linear trends before and during restructuring from 
the crude analysis. The monthly rates of change of 
severe and moderate overcrowding from the crude 
analysis are shown in Table 2. Before restructur- 
ing, severe overcrowding was not increasing, while 
moderate overcrowding was decreasing slightly 
(—0.05% per month, p = 0.01). During restructur- 
ing, overcrowding began to increase significantly. 
Severe and moderate overcrowding both began to 
increase at a rate of 0.4% per month (p = 0.0001), 
and the differences between the rates in the two 
time periods were significant for both levels of 
overcrowding (p = 0.0001). The autoregression 
models demonstrated excellent fit an R 2 = 0.94 and 
0.83 for severe and moderate overcrowding, re- 
spectively. 

Results after Controlling for ED Utilization. 

The multivariate analysis controlled for ED utili- 
zation and patient demographics over 96 months 
{n = 59 before restructuring and n = 37 during re- 
structuring). Overall, total visits averaged 47,098 
per month, the mean age of the ED patients was 
38.7 years, and 50.4% of the patients were female. 
An independent association between restructuring 
period and overcrowding persisted in the multi- 
variate analysis (Table 3). The restructuring pe- 
riod independently predicted increases in average 
severe and moderate overcrowding of 0.2% (p = 
0.0001) and 0.5% (p = 0.0001) per month, respec- 
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Figure 1. Monthly emergency department overcrowding from 1991 to 2000 and linear trends before and during 
hospital restructuring. 
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tively, and the differences before and during re- 
structuring were significant for both levels of 
overcrowding (p = 0.0001). The multivariate auto- 
regression models demonstrated excellent fit an R 2 
= 0.86 and 0.87 for severe and moderate over- 
crowding, respectively. 

Gender was a significant independent predictor 
of overcrowding: for every 1% increase in the pro- 
portion of females, severe overcrowding increased 
by 0.5% (p = 0.03), and moderate overcrowding in- 
creased by 1.7% (p = 0.001). The average age of ED 
patients was an independent predictor of moder- 
ate, but not severe, overcrowding. For every one- 
year increase in average age, the model predicted 
that moderate overcrowding declined 2% (p = 
0.001). Total number of ED visits was not a signif- 
icant predictor of ED overcrowding; however, there 
was a trend toward an association between in- 
creased patient volume and worsened moderate 
overcrowding (p = 0.09). 

Discussion 

Our results suggest that ED overcrowding was in- 
frequent and stable prior to hospital restructuring, 
but began to increase substantially during restruc- 
turing. Increases in both severe and moderate 
overcrowding remained highly significant even af- 
ter controlling for ED utilization in both periods. 
We found no evidence to suggest that major shifts 
in demographics were responsible for decreased ac- 
cess to timely emergency care. Seasonal effects 
were controlled for in our analysis and are there- 
fore unlikely to account for the sustained increase 
in overcrowding seen since 1997. 

Our study shows that hospital restructuring 
may worsen ED overcrowding. While the total 
number of visits remained fairly steady over the 
study interval, five EDs out of 20 (25%) closed fol- 
lowing restructuring (Table 1). This compares with 
an 8% reduction in the number of EDs in the 
United States over five years from 1994 to 1999. 6 
These five EDs treated 15% of all Toronto ED pa- 
tients in the last year that they were open. In ad- 
dition, the rate at which EDs closed may have ex- 
acerbated overcrowding: the first three EDs were 
closed within seven months of each other, and the 
other two followed within the next two and a half 
years. The rapid pace of closures in Toronto may 
not have allowed the remaining EDs to expand ser- 
vices or improve efficiency rapidly enough. 

Hospital restructuring in Toronto resulted in a 
net reduction of acute care beds, a factor that has 
been previously suggested as a cause of ED over- 
crowding. 3-6 However, acute care beds began to be 
closed before the restructuring process began (Ta- 
ble 1), primarily in response to budget cutbacks. 15 
A total of 2,890 of 9,727 (30%) acute care beds were 



TABLE 2. Rate of Increase of Emergency Department 
Overcrowding before and during Restructuring 



1 7"/~\ 1 AT 




XvdLc Ul l^Ildllge 111 


Over- 




Percent per Month 


crowding 


Time 


(p-value) 


Severe 


Before restructuring 


0.002 (0.92) 




During restructuring 


0.38 (0.0001) 




Difference (during— before) 


0.38 (0.0001) 


Moderate 


Before restructuring 


-0.05 (0.01) 




During restructuring 


0.40 (0.0001) 




Difference (during— before) 


0.45 (0.0001) 


TABLE 3. Determinants of Emergency Department (ED) 


Overcrowding before and during Restructuring 


Level of 






Over- 




Coefficient 


crowding 


Independent Variables 


(p-value) 


Severe 


Time 






Before restructuring 


-0.01 (0.49) 




During restructuring 


0.23 (0.0001) 




Difference (during— before) 


0.25 (0.0001) 




Total ED visits 


0.00004 (0.26) 




Average age 


-0.04 (0.83) 




Proportion of females 


51.90 (0.03) 


Moderate 


Time 






Before restructuring 


0.00 (0.99) 




During restructuring 


0.49 (0.0001) 




Difference (during— before) 


0.49 (0.0001) 




Total ED visits 


0.0002 (0.09) 




Average age 


-1.97 (0.001) 




Proportion of females 


165.66 (0.001) 



closed between 1991 and 1997, 19 but no increase in 
ED overcrowding was seen. In comparison, a fur- 
ther 943 beds (14%) were closed from 1998 to 2000, 
the period during which ED overcrowding wors- 
ened substantially. 

We believe that these results suggest that the 
bed closures that occurred as part of systematic 
restructuring took place within a hospital system 
already operating at close to capacity. Excess ca- 
pacity, reduced demand, or enhanced hospital ef- 
ficiency may have mitigated the impact of earlier 
bed closures. In each year during the restructuring 
period, the occupancy rate of acute care beds in 
Toronto hospitals exceeded 90% and peaked at 96% 
in 2000. 4 A British study suggested that normal 
fluctuation in demand for emergency admissions 
will result in bed shortages and periodic bed crises 
if average acute care bed occupancy rises to 90%. 30 

We found that total ED visits did not predict 
overcrowding, though there was a trend toward an 
association for moderate overcrowding. This is not 
surprising since large changes in visit rates rarely 
occur in large populations. Other studies have also 
found that increasing ED utilization is not a major 
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cause of increased hospital admissions, 31 or of in- 
creased diversion of ambulances. 32 

Conversely, a higher proportion of female ED 
patients was found to predict worsened overcrowd- 
ing. This may reflect the fact that atypical pre- 
sentations are more common in women, for exam- 
ple, in cardiac disease, 33 or that the differential 
diagnoses are more varied, for example, in abdom- 
inal pain. 34 Hence, additional time and more inten- 
sive investigations may be needed for women as 
compared with men. 

Average age was not associated with severe 
overcrowding, and was predictive of reduced mod- 
erate overcrowding. This may reflect higher 
thresholds for the use of interventions in elder pa- 
tients. Indeed, it is known that elder patients with 
acute myocardial infarctions are less likely to re- 
ceive thrombolysis, despite proven benefits of the 
therapy, 35 ' 36 suggesting that they are treated less 
intensely than are younger patients. Similarly, 
elders may be less likely to receive other resource- 
intensive medical interventions, such as prolonged 
cardiac monitoring or admission to an intensive or 
coronary care unit bed, and hence contribute less 
to overcrowding. The explanation for this associa- 
tion requires further study. 

Limitations and Future Questions 

Our study is limited by several factors. First, there 
may be other contemporaneous factors accounting 
for the increased overcrowding not considered in 
our analysis. However, we are aware of no other 
important changes in the operation of hospital, 
emergency, or other health services in the region 
over the same time period. Similarly, it is doubtful 
that changes in patterns of morbidity or severity 
of illness before and during restructuring would be 
sufficiently dramatic to explain our findings. In- 
deed, age is an important predictor of acuity and 
comorbidity, but controlling for this factor did not 
change the conclusions. Changes in ED treatment 
practices will have taken place over the study pe- 
riod, but their impact on overcrowding is difficult 
to predict. Finally, patients during the restructur- 
ing period may have tended to present more errat- 
ically than in earlier years (that is, in intermittent 
surges rather than in a steady stream); such un- 
even demand could exacerbate ED overcrowding. 
Nonetheless, we believe it is highly unlikely that 
these factors could be sufficient to account for the 
dramatic increases in overcrowding seen since 
1997. 

An additional limitation is that our analysis 
considers that restructuring took place entirely af- 
ter 1997. This may appear artificial, since there 
are anticipatory changes going on within any com- 
plex system. Indeed, reductions to hospital budgets 



began as far back as 1991, resulting in fewer 
staffed acute care beds even before the restructur- 
ing report was released. 19 However, such changes 
were not carried out systematically, and there 
were no acute care hospital or ED closures before 
November 1997. 

Hospital restructuring is unlikely to go away. 
Therefore, future research should focus on deter- 
mining which aspects of restructuring are most 
closely associated with ED overcrowding. The ex- 
tent to which system-level factors such as ED clo- 
sures or the reorganization of clinical services in- 
dependently affect overcrowding is unknown. 
Similarly, studies at the hospital level are needed 
to better understand the most important factors 
behind day-to-day ED overcrowding at individual 
institutions. 

Conclusions 

To our knowledge, this study represents the most 
extensive longitudinal study of ED overcrowding in 
the literature. Our results are important since hos- 
pital restructuring is occurring across North Amer- 
ica and other parts of the world, 61516 yet the impact 
is often poorly evaluated. 20 

In the future, when resource reductions are oc- 
curring within a hospital system, we believe that 
the pace at which these changes take place should 
be carefully considered. A reduced rate may allow 
for interim assessments of the cumulative impact 
of the changes, and allow more time to increase the 
efficiency and capacity of remaining resources. 
Similarly, the impact of resource reductions is 
likely to depend on the degree of excess capacity 
and opportunity for enhancing efficiency within 
the system. The impact of early resource reduc- 
tions, such as acute care bed closures, may not pre- 
dict the impact of subsequent ones, and further re- 
ductions in resources may cause disproportionate 
disruptions. 30 

From a political perspective, closing beds, hos- 
pitals, or EDs is best done over a short time inter- 
val to avoid accusations of singling out individual 
institutions and to limit time for opposition to de- 
velop. From a medical perspective, however, de- 
creasing resources is like withdrawing medica- 
tions: it is best done slowly over an extended 
period in order to monitor the impact and adjust 
the process. These different perspectives lead to 
different approaches, and we can offer no easy res- 
olution to this tension. It is, however, one more 
reason why clinicians and regulators sometimes do 
not agree. 

The authors thank Dr. Muhammad Mamdani, Ms. Jeri Sever, 
and Ms. Lina Paolucci for their help and advice in the comple- 
tion of the manuscript. 
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